PCX 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




INTERNATIONAL APPLICATION PUBUSHED UNDER THE PATENT COOPERATION TOEATY (PCT) 



(51) International Patent Classification 6 : 
G02B 21/22, A61B 19/00 



Al 



(11) International Publication Number: WO 95/25979 

(43) International PubUcaUon Date: 28 September 1995 (28.09.95) 



(21) International Application Number: PCT/IB95/00179 

(22) International Fifing Date: 17 March 1995 (17.03.95) 



EP 



(30) Priority Data: ^ 

94200761.8 24 March 1994 (24.03.94) 

(34) Countries for which the regional or 

international application was filed: NL et al, 



(71) Applicant: PHILIPS ELECTRONICS N.V. INUNLl; Groe- 
newoudsewcg l/NL-5621 BA Eindhoven (NL). 

(71) AppUcant (for SE only): PHILIPS NORDEN AB [SE/SE]; 

Kottbygatan 5, Kista» S-164 85 Stockholm (SE). 

(72) Inventor: ZONNEVELD. Frans, Wessel; Groenewoudseweg I, 

NL-5621 BA Eindhoven (NL). 

(74) Agent: SCHOUTEN. Marcus, Maria; Intemationaal Octroolbu- 
reau B.V., P.O. Box 220, NL-5600 AE Eindhoven (NL). 



(81) Desienatcd States: JP, European patent (AT. BE, CH, DE, DK, 
FR. GB, GR. IE, IT. LU, MC, NU PT, SE). 



Published 

With international search report. 



(54)Tltie: OPERATING MICROSCOPE 
(57) Abstract 



W invention provides an operating micjoscope f<^^ ""^JZ^ot^l^S'S^i^l 




FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to (he PCT on the front pages of pamphlets publishing international 
applications under the PCT. 



AT 


Atutria 


GB 


United Kingdom 


MR 


Mauritania 


AU 


Australia 


GE 


Georgia 


MW 


Malawi 


BB 


Baibados 


GN 


Guinea 


NE 


Niger 


BE 


Belgium 


GR 


Greece 


NL 


Netherlands 


BF 


Burkina Paso 


HU 


Hungary 


NO 


Norway 


BG 


Bolgaria 


I£ 


Ireland 


NZ 


New Zealand 


BJ 


Benin 


IT 


Italy 


FL 


Poland 


BR 


Brazil 


JP 


Japan 


FT 


Portugal 


BY 


Belarus 


KE 


Kenya 


RO 


Romania 


CA 


Canada 


KG 


Kyrgystan 


RU 


Russian Federation 


CF 


Central African Republic 


KP 


Democratic People's RepubUc 


SD 


Sudan 


CG 


Congo 




of Korea 


S£ 


Sweden 


CH 


Switzerland 


KR 


Republic of Korea 


SI 


Slovenia 


CI 


cote d'lvoire 


KZ 


Kazakhstan 


SK 


Slovakia 


CM 


Cameroon 


LI 


Liechtenstein 


SN 


Senega] 


CN 


China 


LK 


Sri Lanka 


TD 


Chad 


CS 


Czechoslovakia 


LU 


LoxembouiK 


TG 


Togo 


CZ 


Czech RepubUc 


LV 


Latvia 


TJ 


Tiyikiatan 


DE 


Germany 


MC 


Monaco 


TT 


Tdnidad and Tobago 


DK 


Denmark 


MD 


Republic of Moldova 


UA 


Ukraine 


ES 


Spain 


MG 


Madagascar 


US 


United States of America 


FI 


Finland 


ML 


MaU 


uz 


Uzbekistan 


FR 


IVance 


MN 


Mongolia 


VN 


Viet Nam 


GA 


Gabon 











wo 95/25979 j PCr/IB95/00179 

Operating microscope. 



The invention relates to an operating microscope for observing an 
operating field comprising an image display device for displaying an image derived from 
registered image data, and also comprising an optical system for combining the derived 
image with the obsCTvation of the operating field. 
5 An operating microsa^ of this kind is known from the article "A 

frameless stereotaxic integration of computerized tomographic imaging and the opiating 
microscope" in Journal of Neurosurgery 65 (1986), pp. 545-549. 

The known operating microscope comprises an imaging device which 
includes a miniature black and white display screen on which a contour of a relevant part of 
10 the operating field is displayed. The imaging device also comprises a beam spUtter whereby 
the contour displayed on the miniature display screen and the actual operating field are 
simultaneously visualized for the usw of the operating microscope. Using an arithmetic 
device, the contour of the relevant part, for example a tumor to be removed, in the operating 
field is derived from image data (CT data) previously registered by means of an X-iay 
15 computerized tomography device. A drawback of the known operating microscope consists in 
that during observation of the actual operating field only a Umited image data visualization, 
containing two-dimensional information, is available to the usw. 

For projection of the contour derived from the CT data it is necessary to 
register the CT data and the optical axis of the microscope in a common coordinate system. 
20 From the cited article it is known to provide fiducial markers on tiie patiait to be examined 
for this purpose. The markers are non-transparent to X-rays and are taken up in the CT data. 
The position of the operating microscope is determined by means of a three-dimensional 
acoustic referencing system which utilizes an acoustic localizer which generates ultrasonic 
pulses in a spark gap of a spark plug attached to the operating microscope. The ultrasonic 
25 pulses are picked up by three microphones which are mounted on a stand and which 

determine tiie coordinate system in the operating room. At the beginning of an operation tiie 
operating microscope is successively directed to tiie markers and tiie successive positions of 
ttie operating microscope are registered in ttie coordinate system by the acoustic localizer. 
For a new setting of tiie operating microscope, involving selection of a new focal plane, tiie 
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position of the operating microscope should again be determined by means of the acoustic 
referencing system. From the CT data there arc subsequently derived image data which 
correspond to a slice of the patient in the focal plane whereto the operating microscope is 
adjusted, and from these image data a contour of relevant structures, for example a tumor, is 
5 derived. 

It is inter alia an object of the invention to provide an operating 
microscope which offers access to as much information as possible from recorded image data 
of the operating field, or also of a vicinity of the operating field, during use. 

To this end, an operating microscope according to the invention is 

10 characterized in that the optical system comprises means for spatially visualizing the derived 
image in a manner corresponding to a spatial observation of the operating field. 

The user of an operating microscope according to the invention has access 
to three-dimensional information from image data relating to the operating field or also to a 
vicinity of the operating field. The image data have been registered, for example prior to an 

15 operation, by way of an imaging means such as an X-ray computerized tomography (CT) 
device or a magnetic resonance imaging (MRI) device. The user, for example the surgeon or 
his/her assistant observes the operating field via the operating microscope, but can also 
compare the operating field observed with a visualization of the same field obtained from the 
registered image data. The visualization contains three-dimensional image information and 

20 takes into account the viewing angle and the depth with which the actual operating field is 
observed by the operating microscope. It is thus achieved notably that the display of the 
three-dimensional image information and the observation of the operating field register as 
well as possible. The visualization of the three-dimensional image data may constitute a 
complete three-dimensional image in which directions, distances and orientations are visible. 

25 The visualization of the three-dimensional image data may also be a partly three-dimensional 
representation with directions and orientations but without spacings; such a representation is 
sometimes referred to as a 2V4-dimensional image. 

The image data can be visualized, for example by means of one or more 
miniature display tubes. The dimensions of the display tubes are preferably as small as 

30 possible so as to keep the dimensions of the operating microscope according to the invention 
acceptably small, thus enabling flexible use during an operation. Colour LCD display screens 
can also be used for the visualization of the image data. 

Because a visualization of three-dimensional image information is 
available in combination with a view of the actual operating field, the user of the operating 



wo 95/25979 ^ PCT/IB95/00179 

microscope has a better and more direct view with more information of the operating field, 
because the user sees the visualization of the image data and the operating field three- 
dimensionally in about the same way. The user of the operating microscope thus has access 
to three-dimensional information which contains treatment-supporting information, without it 

5 being necessary to interrupt the use of the operating microscope. The treatment-supporting 
information includes, for example an image of the operating field in which pathologic and 
normal morphologies are visualized in a suitably distinct manner. If desired, the user of the 
operating microscope also has access to a visualization of a vicinity of the actual operating 
field. The user can thus more readily make a decision as regards the justified and/or effective 

10 continuation of a medical intervention such as an operation. 

A further preferred embodiment of an operating microscope according to 
the invention is characterized in that the visualization of image data constitutes a stereoscopic 
image. 

The visualization of three-dimensional information in the form of a 

15 stereoscopic image offers the advantage that the user of the operating microscope sees the 
visualization of image data with depth. The image data are preferably visualized in 
conformity with the setting of the operating microscope for the observation of the actual 
operating field. The visualization of the three-dimensional image data then spatially registers 
as well as possible with the image of the actual operating field. Visualization in the form of a 

20 stereoscopic image offers the advantage that the user of the operating microscope can 
compare information from the registered image data directly with the observation of the 
actual operating field, without it being necessary for the user of the operating microscope to 
interpret the visualization of the image data. 

A further preferried embodiment of an operating microscope according to 

25 the invmtion comprises a binocular with a left channel and a right channel and is 

characterized in that a left image of the image data visualization is reproduced in the left 
channel and a right image is reproduced in the right channel, the left image and the right 
image together constituting the stereoscopic image. 

An operating microscope according to the invention which comprises a 

30 binocular can visualize the stereoscopic image by means of a comparatively simple 

construction. From the image data there are derived a left image and a right image, i.e. the 
left image and the right image visualize image data corresponding to the operating field, or 
also to a vicinity thereof, as seen by the user's left eye and right eye, respectively. The 
images are displayed in the left channel and the right channel of the binocular operating 
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4 

microscope. The user of the operating microscope then observes a stereoscopic image with 
depth which is composed from the image data previously registered by an imaging means. 

It is also an object of the invention to provide an operating microscope 
which keeps the visualization of image data with three-dimensional information in conformity 
5 with the setting of the operating microscope. 

A further preferred embodiment of an operating microscope according to 
the invention is characterized in that the operating microscope comprises at least one position 
sensor for applying at least one electronic position signal to a converter for deriving a 
variable setting of the operating microscope and for applying an adjustment signal, 

10 corresponding to the setting, to an image processing unit for processing the image data for 
visualization in conformity with the setting of the operating microscope. 

In order to compare the three-dimensional visualization, for example in 
the form of a stereoscopic image, with the observation of the actual opiating field, the 
three-dimensional information is preferably visualized in conformity with the setting of the 

15 operating microscope*. Preferably, the microscope viewing angle, magnification and 

perspective of observation of the actual operating field are the same as used to visualize the 
three-dimensional image data. To this end, the image data are vistudized in the same 
coordinate system as the actual oi)erating field. In order to register the setting of the 
operating microscope and to determine said coordinate system, one or more position sensors 

20 are provided. The position sensors are provided, for example on the stand wherefrom the 
operating microscope is suspended and also on an adjusting mechanism for the objective lens 
whereby the magnification is (also) adjusted. The position sensors are preferably constructed 
as potentiometers, because potentiometers do not cause sparks so that they can also be used 
in an operating room in which volatile, combustible substances are used for anaesthesia. A 

25 converter conv^ts the electronic signals supplied by the position sensors into adjustment 
signals which r^resent the setting (settings) of the operating microscope. The adjustment 
signals are applied, together with the image data, to an image processing unit in which they 
are processed so as to form a visualization corresponding to the setting of the operating 
microscope. If desired, th& position sensors may also be activated during operation of the 

30 operating microscope in order to supply adjustment signals in response to a change of the 
setting of the operating microscope. The im^e processing unit keeps the visualization of the 
image data in conformity with the setting of the operating microscope by means of said 
adjustment signals. 

A further preferred embodiment of an operating microscope according to 
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the invention is characterized in that the operating microscope is provided with a control unit 
for forming a sectional plane through the image data by means of an image processing unit. 

Such a sectional plane through the image data preferably corresponds to 
an adjusted fofcal plane of the operating microscope or to a plane in the adjusted depth of 
5 focus range of the operating microscope. Such a sectional plane is chosen by the user by 
means of a control unit which is coupled to the image processing unit, or which forms a part 
thereof, in order to adjust the image processing unit for the formation of a desired sectional 
plane. The sectional plane can also be derived from the adjustment signals by the image 
processing unit. When an sectional plane has been formed through the image data, the image 
0 data are further processed so as to obtain a visualization of the image data relating to 

structures situated to the other side of the sectional plane, viewed in the viewing direction of 
the user. For example, the unage data can be processed in the image processing unit in such 
a manner that the image data of the structures present between the user and the sectional 
plane are visualized in a transparent manner; they can also be omitted from the visualization. 
15 It is thus achieved that the user has an unobstructed view of the structures at the level of the 
operating field, which view is not obscured by visualization of image data of structures 
present in zones between the user and the selected sectional plane. 

A further preferred embodiment of an operating microscope according to 
the invention is characterized in that the operating microscope comprises an adjustable 
20 coupling device for selectively observing the operating field, the visualization of the image 
data, or simultaneously a composite image of the operating field and the visualization of the 
image data. 

In order to enable easy comparison of the actual operating field and the 
visualization of image data of the operating field, or of a vidnity thereof, by the operating 

25 microscope according to the invention, the operating microscope can be switched between 
observation of the operating field and observation of the visualization of image data. The 
operating microscope is preferably constructed so that it can be svwtched by means of an 
adjustable coupling device. The coupling device combines the visualization of the image data 
with the visualization of the actual operating field. The coupling device is adjustable either to 

30 enable tiie user of the operating microscope to observe the operating field or to offer the user 
a visualization of image data, simultaneously with the observation of the actual operating 
field or not. As a result, the operating microscope enables the user either to view alternately 
the actual operating field or tiie visualization of image data for the operating field, or also a 
vicinity thereof, or to view an image of the actual operating field combined with the 
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visualizadon of the image data. 

A further preferred embodiment of an operating microscope according to 
the invention is characterized in that the coupling device comprises at least one movable 
ihirror. 

5 A comparatively simple and reliable construction of an adjustable coupling 

device is achieved by using one or more movable mirrors, or other reflectors. In a deflected 
position of such a movable mirror the user of the operating microscope can view the actual 
operating field, and in an active position such a mirror is adjusted so that the visualization of 
image data is mirrored into the optical path of the ocular section of the operating microscope 

10 so that it becomes visible to the user. The observation of the actual operating field in 
combination with the visualization of image data is made possible for the user by 
constructing the miirors to be partly or semi-transparent. 

The invMition will be described in detail hereinafter on the basis of an 
embodiment and the accompanying drawing; therdn: 

15 Fig. 1 shows diagrammatically an operating microscope according to the 

invention. 

Fig. 1 is a diagrammatic representation of an operating microscope 
according to the invention. The operating microscope 1 comprises an adjustable objective 
lens 2 and binocular 3 with a set of prisms 4, 5 and 6. The operating microscope is 

20 connected, via a hinge 7, to a suspaision arm 8 which forms part of a system of rods 9 
which also comprises two parallel rods 10 and 11. The parallel rods are interconnected by 
connection members 12 and 13 which are connected to the respective parallel rods by way of 
pivots 14, 15, 16 and 17. The system of rods 9 is connected to a stand 19 by way of a 
further pivot 18. The operating microscc^ 1 can be displaced at random by means of the 

25 rod system and the suspension arm so as to be aimed at an operating field 20. In the present 
example tiie operating field is a part of the skull volume of a patient 21 undergoing brain 
surgery. 

The pivots 14, 15, 16, 17 and 18 and the hinge 7 are provided with 
potentiometers. The potentiometers act as position sensors and apply electronic position 
30 signals to a converter 30 which derives the viewing direction of the operating microscope and 
the distance between the operating microscope and the operating field from the electronic 
position signals. The viewing direction is the angle at which the operating field 20 is 
observed by the operating microscope. The setting of the objective lens is converted, by 
means of a position sensor 22, into an adjustment signal which is also applied to the 
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converter 30 which derives the adjusted magnification of the operating microscope therefrom. 
The viewing direction and the distance are determined on the basis of markers 23 provided 
on the patient. In order to define positions in the three-dimensional space, at least three 
markers are provided on the patient; however, in order to enable tests to be carried out and 
5 adjustment errors to be avoided, preferably more than three markers are used. 

Adjustment signals svqiplied by the converter and representing the viewing 
direction, the distance and the magnification are appUed to an image processing unit 31. 
Three-dimensional image data of the patient 21 to be examined and/or treated are stored in 
an image memory 32. These image data have been acquired, for example by means of an 
10 imaging means (not shown) such as an X-ray computerized tomography device or a magnetic 
resonance imaging device. The markers provided on the patient are such that they are also 
visualized by the imaging means. On the basis of the adjustment signals and the image data, 
the image processing unit 31 forms an image signal for a stereoscopic image which 
corresponds to the operating field, or also to a vicinity thereof, and which visualizes the 
15 image data of the operating field, or also of a vicinity thereof with the same viewing 
direction, distance and magnification as used to observe the operating field itself. The 
stereoscopic image is visualized by a display unit 33 which comprises, for example two 
miniature display tubes 34 and 35. To this end, the stereoscopic image signal is applied to 
the display unit 33. The first miniature display tube 34 displays, witii tiie given viewing 
20 direction, distance and magnification, the image data of tiie operating field for the user's left 
eye. Similarly, the second miniature display tube 35 displays the image data for the user's 
right eye in die same circumstances. Image data displayed on the display screens of the 
miniature display tubes are coupled into the operating microscope by means of a coupling 
device comprising coupling-in mirrors 37 and 38. The coupling-in mirrors can be moved 
25 between a deflected poation, as denoted by dashed lines in the Figure, and an active position 
as denoted by soUd lines. Via a selector switch 39, the user selects either the deflected 
position or tiie active position of the coupling-in mirrors. The display unit and die coupling- 
in mirrors constittite, together witii the image processing unit 31, a display device for flie 
visualization of image data of the operating field or also of a vicinity of the operating field. 
30 Via the binocular the user sees the operating field itself in alternation with the visualization 
of the image data of the same operating field or, if desired, of an area in a vicinity thereof. 
By alternating the positions of the coupling-in mirrors, the user of the operating microscope 
alternately observes the operating field itself and the processed image data of (a vicinity of) 
the operating field. When semi-transparent mirrors or tilting prisms are used for the 
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coupling'in mirrors, the operating field can be observed simultaneously with the visualization 
of the image data. This enables comparison of the operating field observed with image data 
thereof. Instead of using movable mirrors or tilting prisms, use can also be made of 
stationary semi-transparent mirrors or stationary splitting prisms. The selector switch is then 
5 also suitable for switching the display unit on and off in order to enable observation of 
alternately the operating field alone or the operating field together with the reproduction of 
the image data. 

When use is made of semi-transparent minors or splitting prisms, a part 
of the visualization provided by the display unit 33 is transmitted by the semi-transparent 

10 mirrors 37, 38 and a part of the image of the operating field itself is reflected so that it does 
not reach the exit of the binocular 3. A video camera 40 picks up the transmitted part of the 
visualization of the display unit and the reflected part of the image of the operating field 
itself and converts them into a video signal which is applied to a monitor 41. The monitor 41 
then displays a composite image which is composed of the image of the operating field itself 

15 and of the visualization of three-dimensional image data. This composite image is the same 
as that of the operating field with simultaneous visualization by the display unit as viewed by 
the user of the operating microscope. Assistants of the user can then follow the progress of 
the operation on the monitor 41. If desired, the monitor 41 may also be arranged outside the 
operating room so that the operation can also be followed outside the operating room. 

20 The processing of the image data includes, for example the accentuation 

of tumor tissue already detected by the imaging means. Recognition of the tumor tissue in the 
operating field is then facilitated by direct comparison with the image of the actual operating 
field. If desired, image data of a zone in the vicinity of the operating field can also be 
visualized, eventhough this zone in the actual operating field is (still) observed from view. 

25 Viaz selector switch 36, the user can instruct the image processing unit to 

form a sectional plane through the image data and to process the image data in such a 
manner that the image data of structures present between the user of the operating 
microscope and the selected sectional plane do not contribute to the stereoscopic image, thus 
creating an unobstructed view of the structures of interest in the image of the operating field 

30 and a vicinity thereof as produced by the image processing unit. 
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CLAIMS : 



L An operating microscope for observing an operating field, comprising an 

image display device for displaying an image derived from registered image data, and also 
comprising an optical system for combining the derived image with the observation of the 
operating field, characterized in that the optical system comprises means for spatially 
5 visualizing the derived image in a manner corresponding to a spatial observation of the 
operating field. 

2. An operating microscope as claimed in Claim 1, characterized in that the 
visualization of image data constitutes a stereoscopic image. 

3. An operating microscope as claimed in Claim 2, comprising a binocular 
10 with a left channel and a right channel, characterized in that a left image of the image data 

visualization is reproduced in the left channel and a right image is reproduced in the right 
channel, the left image and the right image together constituting the stereoscopic image. 

4. An oi>erating microscope as claimed in any one of the preceding Claims, 
characterized in that the operating microscope comprises at least one position sensor for 

15 applying at least one electronic position signal to a converter for deriving a variable setting 
of the operating microscope and for applying an adjustment signal, corresponding to the 
setting, to an image processing unit for processing the image data for visualization in 
conformity with the setting of the operating microscope. 

5. An operating microscope as claimed in any one of the preceding Claims, 
20 characterized in that the operating microscope is provided with a control unit for forming a 

sectional plane through the image data by means of an image processing unit. 6. An 
operating microscope as claimed in any one of the preceding Claims, characterized in that 
the operating microscope comprises an adjustable coupling device for selectively observing 
the operating field, the visualization of the image data or simultaneously a composite image 
25 of the operating field and the visualization of the image data. 

7, An operating microscope as claimed in Claim 5, characterized in that the 

coupling device comprises at least one movable mirror. 
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